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Abstract. We perform a smoothed analysis of the componentwise con- 
dition numbers for determinant computation, matrix inversion, and hnear 
equations solving for sparse n x n matrices. The bounds we obtain for the ex- 
pectations of the logarithm of these condition numbers are, in all three cases, 
of the order C'(logn). As a consequence, small bounds on the smoothed loss 
of accuracy for triangular linear systems follow. 

1 Introduction 

The most commonly used solver of linear systems of equations, Gaussian 
elimination, reduces the input system Ax = c to a system Lx = b with 
L lower triangular (and same solution x). Then, it solves the latter by 
forward substitution. As a consequence, triangular systems of equations are 
routinely solved by computer. 

Almost on every occasion, the accuracy of the computed solution is very 
high. Yet, the reasons for this accuracy have been dodging researchers for 
quite a while. In the early 1960s J.H. Wilkinson noted that "In practice one 
almost invariably finds that if L is ill-conditioned, so that ||L||||L^^|| ^ 1, 
then the computed solution of Lx = b (or the computed inverse) is far 
more accurate than [what forward stability analysis] would suggest" [HI 
p. 105]. To make things worse, ill-conditioned matrices L in the sense above, 
appeared to be ubiquitous. This was explained by by D. Viswanath and 
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N. Trefethen in [9]. Indeed, if denotes a random triangular n x n ma- 
trix (whose entries are independent standard Gaussian random variables) 
and Kn = ||L„|| ||L~"^ II is its condition number (which is a positive random 
variable) then, the main result in [9] shows that 



as n — )• oo. A straightforward consequence of this result is that the expected 
value of log Kn satisfies E(logK„) = il(n). 

Putting all the above together we can describe the situation as follows: 

Triangular systems of equations are generally solved to high ac- 
curacy in spite of being, in general, ill-conditioned. 

In 1989 N. Higham [3] pointed out that the backward error analysis given 
by Wilkinson for forward substitution yields (small) componentwise bounds 
on the perturbated matrix. One can therefore deduce small forward error 
bounds for these solutions if the componentwise condition number c{L, b) 
of the pair (L, b) — instead of k{L) — is small. In a recent paper [2] we 
showed that this is the case for random triangular matrices L. Here 'random' 
means that the entries of L are i.i.d. standard random variables. This result 
provides an explanation of the high accuracy achieved in general by forward 
substitution. 

In the last decade, however, the suitability of this average analysis to 
reflect performance of algorithmic practice was questioned. The objec- 
tion raised is that the probability distribution underlying these analyses 
— usually, a centered isotropic Gaussian — is chosen because of technical 
reasons and not because it models "the real world." Because of this, it 
may well happen that the resulting estimates are too optimistic, just as 
worst-case analysis is often claimed to be too pessimistic. The proposed 
alternative, smoothed analysis, interpolates between worst-case and average 
analyses and typically studies, for a function / : — )• M, the quantity 



Here N{a,a'^\d) denotes the normal distribution centered at a and with 
covariance matrix cr^ Id, where Id is the identity matrix. In case / is homo- 
geneous (i.e., /(Aa) = /(a) for all A 7^ 0) it is common to scale the covariance 
matrix and study 




— )• 2 almost surely 



sup E 



sup E 

aeKP a^N{a,a'^\\a\\\d) 
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or, equivalent ly, 

sup E /(a)- 

||a||=l a~7V(a,o-2|d) 

In this case, the interpolation mentioned above comes from the fact that 
when £7 = the expression above reduces to the worst-case of / and when 
cr — )• oo one approaches the usual average analysis. We won't elaborate 
here on the virtues of smoothed analysis. The interested reader can find 
expositions of these virtues in [H |5l |6l |7| or |1] §2.2.7]. We will instead 
proceed to state the main results of this paper. For a matrix A we define 
the max norm 

h4 jiiax = max cij j . 

Theorem 1. Let T denote the set of n x n lower triangular matrices. Let 
L £ T and b £ R."- be such that ||L||max < 1 and \\b\\oo < 1- For L £ T 
and b G M" let c{L, b) denote the componentwise condition number, for the 
problem of linear equation solving, of the pair {L,b). Then, for any real 
number t > n(n + 1) we have 

Prob {c(L,6 >t} < [ ^ \ - 

{L,b)r^NriiL,b),a^\d) V J \t- n{n + 1) / V vr 

and, for any (3 > 1, 

E (log^(c(L,6))) < log^ ( +51og^(n) + ^. 

The subindex T in N-i-{{L,b),a'^\d) is meant to denote that L is triangu- 
lar. That is, the only entries of L which are drawn from the Gaussian 
N{{L,b),a'^\d) are those in its lower part. 

This theorem has immediate consequences for the accuracy of forward 
substitution. Recall (or look at the Overture chapter in [1] for a primer if 
you are not familiar with round-off analysis), a finite precision algorithm 
with machine precision Emach rounds-off all the real numbers z occuring in 
the execution to a rational (floating point) number z satisfying 



RelError(2;) := — -- — < e 



mach 



(we agree this equality to hold if z = 5 = 0). This means that the approxi- 
mation z has logio(7^) correct (significant) digital. 



^AU our discussion holds as well for bits, instead of digits. The modifications required 
are trivial. 
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If we solve a system Lx = b with a finite precision machine we obtain 
an approximation x of the solution x. A (componentwise) extension of the 
notion above measures the relative error of this approximation by 

RelError(x) := max RelError(3;j). 

i<n 

Again, log^Q(RelError~^(x)) provides a lower bound on the number of correct 
digits for all the components of x and hence the loss of precision in the 
computation of x — i.e., the initial precision of our data measured in number 
of correct digits minus the precision of the computed outcome measured in 
the same manner — is 

LoP(x) := logio(e^Lh) - logio(RelError-i(x)). 

Note that if L is singular then x is not well-defined or may not exist. In this 
case we take, by convention, LoP(x) = oo. The following result provides 
a smoothed analysis of this quantity for forward substitution with finite 
precision. 

Corollary 1. Assume we solve systems Lx = b using forward substitution. 
Then, for all L & T and b G with ||Z||inax ^ 1 CL^d \\b\\oo < 1 we have 

E(LoP(x)) = logio (^-^) + 5 logio ^ + logio(log2 n) + 1.452 + o(l). 

Here {L,b) ~ N-]-{{L,b),a'^\d) and o(l) is a quantity that tends to zero with 

^mach ■ 



2 Preliminaries 

2.1 Componentwise condition numbers 

Condition numbers measure the worst-case magnification in the computed 
outcome of a small perturbation in the data. As originally introduced by 
Turing [S], or von Neumann and Goldstine |10j. they were normwise in 
the sense that data perturbation and outcome's error were measured us- 
ing norms (in the space of data and outcomes respectively). In contrast, 
componentwise condition numbers measure both of them componentwise. 

For both data perturbation and output error, the error is measured in a 
relative manner. Because of this, the following form of "distance" function 
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(it is not a distance as is not symmetric) will be useful to define componen- 
twise condition numbers. For points u,v e W we define ^ = {wi, . . . ,Wp) 
with 

Ui/vi if fi / 
ii Ui = Vi = 
otherwise. 



Wi = < 



oo 



Then we define 



u — V 



d{u,v) :- 

Note that, if d{u, v) < oo, 

d{u,v) := mm{i' > | \ui — Vi\ < z/|t;j| for i = 1, . . . ,p}. 

For (5 > and a G we denote S{a, 6) = {x €RP \ d{x, a) < 5}. 

Let P C M?', F : D — )• M'^ be a continuous mapping, and a G P be such 
that 7^ for _7 = 1, . . . , Q'. Then the componentwise condition number of 
F at a is 



c (a) := lim sup 



d{F{x),F{a)) 
d{x, a) 



It is not difficult to see that 



c (a) = max c ^ (a) 

i<9 



(1) 



(2) 



where c^^ (a) denotes the componentwise condition number of a for the jth 
component Fj of F. We will systematically use this form in the rest of this 
paper. 



2.2 Sparse matrices 

In all what follows, for n G N, wc denote the set {1, . . . ,n} by [n]. 

We denote by ^ the set of n x n real matrices and by S its subset of 
singular matrices. Also, for a subset S C [n]^ we denote 

.y^s = {A <E ^ \ if S then a.y = 0}. 

Matrices in ^5 for some 7^ [n]^ (i.e. matrices with a fixed pattern of zeros) 
are said to be sparse. The set S is said to be admissible if ^5 contains some 
invertible matrix. 

In the rest of this paper, for non-singular matrices A, A', we denote their 
inverses by r,r', respectively. Also, we denote by Aij the sub-matrix of A 
obtained by removing from A its ith row and its jth column. 
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The technical results below, Theorems [21 [3] and HI are proved in the 
general context of sparse matrices. Besides triangular matrices, these results 
apply to other classes of sparse matrices such as, for instance, tridiagonal 
matrices. 

2.3 Smoothed analysis 

Let cT > be a fixed number, S C [n]^ be admissible and A = {aij) G 
Extending the notation we used in the Introduction, we will write 
A ~ A^5'(^, cj^ll^llmaxld) to denote that the entry aij of A, with G 5, is 
a random variable with distribution A^(ajj, (T^||^||niax)! whereas the entries 
aij with S are zero. 

In this paper we will only be concerned, for a random sparse matrix A as 
above, with the componentwise condition number of A with respect to a few 
problems. All these condition numbers being, as functions, homogeneous 
of degree 0, we will sistematically consider, without loss of generality, the 
center A of the distribution to satisfy ||^||max = 1 (or, more generally and 
for convenience, ||^||max ^ 1) and therefore, we will take u^ld as covariance 
matrix in our distributions. 

3 Preliminary results 

We prove in this section some bounds on one-dimensional Gaussian random 
variables as well as a proposition on the expectation of positive random 
variables. The main results of the paper will easily follow from them. 

Proposition 1. Let fi, <; > and t > 1 be fixed numbers. Let X ~ N(fi, (j^) 
be a normal distributed random variable. Then 

The proof of Proposition [1] proceeds through a sequence of lemmas. 

Lemma 1. Let /x G M and <j > 6e fixed numbers. Let X ~ A^(/i,<f^) be a 
normal distributed random variable. Then 

Prob{l < X < 1 + e} < - 
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Proof. Since X~iV(/i,c^) 

Prob{l<X<l + .} = lyX^ 



l+£ _(x-j4^ 



1 nr , 

< -W— / Idx 



27r' 



□ 



Lemma 2. Lei /x G M, > 0. Let X ~ -/V(/x, (j^) be a Gaussian random 
variable. Then 



Prob{l < X < 1 + e} < e 



be given by 



Proof. We first assume that > 0. Let r = ^ and / : M - 

f(m) = \ 7^ / e 2m^r^ dx 

^ ^ mr\ 2Tr J I 

so that Prob{l < X < 1 + e} = /(/x). By doing the change of variables 



u 



rV2 



we obtain, 



/(m) 



l + £ — m 
1 / mrV2 _ 2 

e " 

vr ./ 1-'" 

mrv/2 

l + £ — m 
mr\/2 _,,2 



HI 



i 



mrV2 _ 2 , 

e ^ du 



and, hence. 



1 / d 



, , e-^'du-^ l-'^\--'du\. 

vr \ am ./q 



1 — m 
/ mr\/2 

Jo 



Let V = and w = Then 

mr V 2 mr V 2 



/'M 



1 / d fe-^'du-i- re--'du\. 



By the chain rule and the Fundamental Theorem of Calculus, 
V TT \dm dv 7o "'tz diu Jq 



I f dv diu 
TT V dm dm 



(3) 
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We now use that 



dv —(1 + e) , dw 

— and 



dm m^r\/2 dm m^r\f2 

to deduce from ([3]) that 

-mVV2^/'(m) = e"''" - (1 + e)e-"'' 

(l + e-m)^ (l-m)2 

= e 2m2r2 — (1 + e)e 2m2r2 . (4) 

Let be such that 

/(m*) = sup /(m). 

m>0 

Since hm /(m) = hm /(m) = we deduce that /'(m*) = 0. Equation (jH) 
evaluated at m^ then yields 

(l-m«)^ (l + e-m«)2 

which elementary computations show equivalent to 

e2 + 2e(l-m^) = 2m^r2 ln(l + e). 
Since ln(a;) <x — \ for all x > this last equality implies that 

e + 2 - 2m* < 2m^r^ 
which in turm implies, since e > 0, 

r + — 1 > 0. 
Solving this quadratic inequality we deduce that either 



2r^m* > -1 + Vl + 



or 



2r^m* < -1 - \/T+4r^ 



but we can reject the latter since > 0. The former inequality can also 
be written as 



-1 + \/l + 4r2 4r2 2r r 

> 7^ = , = , > 



2r 2r(l + \/rT4^) 1 + Vl + 4r2 1 + r' 



Let Y ~ N (rriif , rriifr) . Using Lemma [T] and this inequality we deduce that 

/(m.) = Prob{l <Y< 1+e} < ^Jl- < e^-±^J^ = e^J^. 

m^r V 2vr r V ivr <j V ivr 

The statement (for the case > 0) now follows since 

Prob{l < X < 1 + e} = /(^) < /(m*). 
We next deal with the case < 0. Since X ~ N{fi,<;'^), 



1 1 



l+e 



Prob{l < X < 1 + e} = -y — y e dx. (5) 

Let y ~ A^(-/x,^2). Then 

1 n~ f^^^ _{£±M)i 

Prob{l < y < 1 + e} = -\ — e ^^dx. (6) 

? V 27r 

Since (x + < (x — for all x G (1, 1 + e), using (0) and ([U]) we obtain 

Prob{l < y < 1 + e} > Prob{l <X <l + e}. 

The result now follows since, by the first case above, the claimed bound 
holds for y. □ 

Proof of Proposition [H We have 

\X\>t\X + l\ ^=f- X2>t2(x + 1)2 

(t^ - l)X^ + 2t2x + < 

< X < 



t-l t+l 



^ 1 + -> —]X>1. 

t-l \ t J 

Letting Y = ( — ^j^) X we conclude that 

Prob{|X| >t|X + l|} = Prob|l<y< 1 + ^-^1 . (7) 



Since F = (-^) X, y ~ N{^y,4) where 



2 



t + l\ , .2 _ / \ 2 



/xy = —j and 4 = ^ — j (8) 

We now apply Lemma [2] to Y with e = to obtain 

Combining ([7]), ([8]) and ([9]) the proof is done. □ 

The fohowing proposition is a variation of a classical result for positive 
random variables (cf. [2, Proposition 2]). 

Proposition 2. Let k,H > and X > 1 be a random variable satisfying 
Prob{X >t} < jSjj for aUt> k + H. Then, for all /S > 1, 

E(log^(X)) < log^ {k + H) + :^. 

Proof. We have 

roo poo 

E(log^(X)) = / Prob{log^(X) > s}ds = / Prob{X > P'}ds 
Jo Jo 

Prob{X > /3"}ds + / Prob{X > (3'}ds 

Jlogpik+H) 

POO 

< logs {k + H)+ / Prob{X > P'}ds. 

J\ogp(k+H) 

Since Prob{X > t] < it follows that 

r°° dt 

E(log^(X)) - log^ {k + H)<k (10) 

J\ogp{k+H) P-H 

Let u — pi^H that du — —\ii.(i{u-\-v?)dt. Then, changing variables 
in ()10p . we obtain 

k /-o du _ k / H 



E(log^(X)) - log^ {k + H)< --^ ^ = In ( 1 + - 



The proof is complete since ln(l + x) < x for all x > —1. □ 
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4 Computation of determinants 



In this section we consider the problem of computing the determinant. Tak- 
ing F{A) = det(^) in ([T|) we obtain the componentwise condition number 
c^^^{A) for this problem. Our main result for this quantity is the following. 

Theorem 2. Let S C [n]'^ be admissible, A E with ||^||niax 

< 1, cj > 

and A ~ A^5'(^, cr^ Id). Then, for any real number t > \S\, 



Prob{c^^*(A) >t} < 
and, for all (3 > 1, 



1 + (t\ f \S\^ \ /2 



E(log«(cdet(^))) < log« + 21og« \S\ + 



a J \t-\S\J V vr 



l + 1.03 



For the proof of this theorem we will make use of the following character- 
ization of c^^^{A) (see [21 Lemma 1.1] for a proof). Denote by jij the entry 
of A~^ on the ith row and jth. column. Then, for any matrix A G ^ \ S, 

c'^\A) = |a.,7,,| • (11) 

Proof of Theorem [H Without loss of generality, we may assume that 
(1,1) G 5" so that ail ~ N{aii,a'^). For a time to come we consider all entries 
of A except an to be fixed. Let Aij be the matrix obtained by removing 
from A the ith row and jth column. By Cramer's rule, 711 = '^^^j.^^ ^ and 
therefore, for t > 1, 

Prob{|aii7ii| > t} = Prob { |aii det(Aii)| >t|det(^)|}. 

Expanding det(74) by the first column of A this equality becomes 



Prob{|aii7ii| > t} = Prob | |aii det(ylii)| >t 
and letting 

^ _ aiidet(^ii) 



5^(-l)'+ia,idet(^a; 

1=1 



Er=2(-l)'+'«iidet(^ii)- 
this equality becomes 

Prob{|aii7ii| > = Prob {\X\ > t\X + 1\} . (12) 
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Since all entries of A, except an are fixed (and an ~ A^(aii, a^)), we have 
X ~ A^(/i, ?^), where 



_ an det(^ii) 

^"Er=2(-l)^+'«^idet(^.i) ' 



cjdet(yln; 



Er=2(-l)'+'«iidet(Aii) 



In particular, 



\fJ-\ +? |ail| < 1 + ^-j^g^j 



5^ CJ O" 

the last since ||A||jnax < 1- By Proposition [H and Equations ([T2|) and p^ . 
we have 

■-,,r, , 1 /l + cX/l 

Prob{|an7ii| > < 



a J \t — 1 J \ IT 

This inequality holds for all fixed values of ai2, ai3, ...ann- Therefore, it holds 
as well when all entries of A are random (as described in Section [2.3p . We 
can show in the same manner that, for all (i, j) G S, 

Prob{K-7,.| > n < (^)(^)vf- 

We now recall that, for all (i,j) ^ S, aij = 0. Hence, by using (fTTj) . for 
t> 1^1, 



Prob{c^^*(A) > t} = Probj ^ |aij7ji| > t| 
= Prob <^ ^ |aij7ii| > * \ 

E (^)(^);! 



(*,i)es 



a J \t — \b\ J \ TT 
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Combining Equation (|15p and Proposition [2] we obtain 
E(log«c^^*(^)) 




The last line above is true because log^(l + x) < for all x > 0. Since 
both a and |5| > 0, 

E(.og,c-(A)) < log, ((i±^) ISf^) + l) 

<log,(i±^)+21og,|S| + i^. □ 

5 Matrix inversion 

We next consider the problem of matrix inversion. For k, I S [n] we consider 
the function F^i : \ S — ^ given by F].i{A) = {A~^)ki. Definition ^ 
applied to this function yields a componentwise condition number c^j(yl) 
and, recall taking the maximum over (k, I) G [n]^ we obtain c^{A). Our 
main result for this quantity is the following. 

Theorem 3. Let S C [n]'^ be admissible, A E such that ||^||max < 1, 
cr > and A ~ Ns{A, cr^ld). Then, for any real number t > 2|5|, 

and, for all (3 > 1, 

E(log^(ct(A))) = log^(^i±^)+21og^(n|5|) + ^. 
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Lemma 3. (12^ Lemma 5]) For A G ^ \ T, and k, / G [n], 

cl{A)<c'^\A) + c'^\Aik). □ 



Proof of Theorem\^ Almost certainly, A G ^\ S. Hence, by Lemma El 
we have, for all A;, / G [n], 

■.t //l^ \ J.T ^ D-^k/^det/ I ^det 



Prob{c\,{A) > t} < Probic^'^^A) + d'^^Aik) > t} 



< Probl^c''\A)>^-oTc''\Aik)>l 

< Prob S^c'^HA) > ^1 + Prob jc^^^Afc) > ^ 
Using Theorem [2] twice, we obtain 



^ / v| - I'^ly V vr V ^ y VI - l-^l 



(J J \t-2\S\J V ^ 
This inequality and the definition of c^{A) yield 

Prob{c"f(A) >t} = Prob <| max^ 4«(^) > * 



< ^ Prob {4(A) >t} 
fc,ze[n] 



< 



_ , a y Vi-2|5|y V TT 



l + a\ /4n2|5|2 



a y V*- 2|5|y V TT 
Finally, by Proposition [2] 



14 



E(log/3(ct(A))) 




the second inequality due to the fact that n,\S\ > 1 and a > 0. □ 



6 Linear equations solving 

We finally consider linear equation solving. For A G ^ \ S and b G M" 
we compute x = A~^b. Thus, for k £ [n], the mapping {A,b) i— )• Xk yields 
(always using ([1])) Ck{A,b) and taking the maximum over k £ [n] we obtain 
the componentwise condition number c{A, b) of the pair {A, b). The following 
theorem is the main result in this section. 

Theorem 4. Let S C [n]^ be admissible, A E o^i^d b G M" such that 
Pllmax < 1 and ||6||oo < 1; cr > 0, A ~ N{A,a'^\d) and b ~ N{b,a'^\d). 
Then, for any real number t > 2|S'|, 

and, for all P > 1, 

E(log/3(ct(^))) = log^(^i±^^ +21n|5|+log^n + ^. 

In what follows let Rk be the matrix obtained by replacing the kth 
column of ^4 by 

Lemma 4. Lemma 6]) For any non-singular matrix A and k £ [n], 

CkiA,b)<c^^\A) + c^^\Rk). □ 
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Proof of Theorem^ By Lemma HI we have, for all A; G [n], 
Prob{cfc(A, b)>t} < Prob{c^"*(^) + c^'*(i?fc) > t} 

< Prob S^c'^\A) > ^1 + Prob S^c''\Rk) > ^| . 

It follows from our hypothesis that ||-Rfc||max ^ 1- We can therefore apply 
Theorem [2] twice to obtain 

and, proceeding as in the proof of Theorem [3l 

Proh{c{A,b) > t} = Proh \ max Ck{A,b) > t} 

[ke[n] J 



< Prob {ck{A,b)>t} 




a )\t-2\S\)\7T- 



A last call to Proposition [2] yields the desired bound for E(log^(c(A, 6)). 

□ 



7 On the accuracy of forward substitution 

We arrive, at last, to the motivating theme of this paper. Theorem [1] is 
an immediate consequence of Theorem S] since lower triangular matrices are 
sparse matrices with S = {(i,j) G [n]^ \ i > j}- One then only needs to use 
that |5| = 

For the proof of Corollary [1] we use a common approach, pioneered by 
Wilkinson, which splits the relative error bound in the computed solution 
RelError(F(a)) as the product of two factors, one depending on the algorithm 
but not on the data (a backward error bound) and another depending on the 
data but not on the algorithm used (the condition of the data) . A backward 
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error bound for forward substitution is shown in the fohowing result, going 
back to Wilkinson [11^ Ch.3,§19], which we quote, omitting some smaller 
details, as given in m Proposition 3.5]. 

Proposition 3. Let L = (lij) G M"^" be a nonsingular triangular matrix, 
b G M", and assume Cmach is sufficiently small (of the order of (logn)~^ ). 
Then, the solution x of the system Lx = b computed with forward substitu- 
tion satisfies 

(L + E)x = b, 

where 

< (21og2n)emach- □ 

Proposition [3] yields a backward error bound of the form -Bemach where 
B = 21og2 n is an expression in the dimension n of the input, independent 

of emach- 

The way such a backward error bound combines with condition to pro- 
duce a bound for the loss of precision, in digits, is (see Theorem 0.3 in [T]) 

LoP(F(a)) < logio B + log^o cond^(a) + o(l). 

Here the o(l) term is an expression tending to zero as Smach does so, cond^(a) 
is the condition number of a and — crucially in our context — if the bound 
-Bemach is componentwisc, as in Proposition [3l this condition number can 
be taken componentwise as well. Doing so for forward substitution and 
X = L~^b we obtain 

LoP(x) < logio(2 log2 n) + logio b) + o(l). 

Taking expectations on both sides and using Theorem [1] proves Corollary [TJ 

References 

[1] P. Biirgisser and F. Cucker. Condition. Forthcoming in Grundleheren 
der mathematischen Wissenschaften, Springer- Verlag. 

[2] D. Cheung and F. Cucker. Componentwise condition numbers of ran- 
dom sparse matrices. SIAM J. Matrix Anal. AppL, 31:721-731, 2009. 

[3] N. Higham. The accuracy of solutions to triangular systems. SIAM J. 
Numer. Anal, 26:1252-1265, 1989. 



17 



[4] D.A. Spielman and S.-H. Teng. Smoothed analysis of algorithms. In 
Proceedings of the International Congress of Mathematicians, volume I, 
pages 597-606, 2002. 

[5] D.A. Spielman and S.-H. Teng. Smoothed analysis: Why the sim- 
plex algorithm usually takes polynomial time. Journal of the ACM, 
51(3):385-463, 2004. 

[6] D.A. Spielman and S.-H. Teng. Smoothed analysis of algorithms and 
heuristics. In Foundations of Computational Mathematics, Santander 
2005, volume 331 of Lecture Notes of the London Mathematical Society, 
pages 274-342, 2006. 

[7] D.A. Spielman and S.-H. Teng. Smoothed analysis: An attempt to 
explain the behavior of algorithms in practice. Communications of the 
ACM, 52(10):77-84, 2009. 

[8] A.M. Turing. Rounding-off errors in matrix processes. Quart. J. Mech. 
Appl. Math., 1:287-308, 1948. 

[9] D. Viswanatah and L.N. Trefethen. Condition numbers of random tri- 
angular matrices. SIAM J. Matrix Anal. Appl, 19:564-581, 1998. 

[10] J. von Neumann and H.H. Goldstine. Numerical inverting matrices of 
high order. Bulletin of the Amer. Math. Soc, 53:1021-1099, 1947. 

[11] J. Wilkinson. Rounding Errors in Algebraic Processes. Prentice Hall, 
1963. 



18 



